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Indication of accuracy of quantitative analysis 



The invention relates to a medical image analysis process which utilizes 
information contained in at least one medical image, in which a quantitative evaluation is 
derived from the medical image analysis process and delivered as an output. 

Modem medical imaging handling protocols increasingly allow complex and 
S involved analysis of acquired image data to produce determinable quantities. For example^ 
protocols exist to calculate perfusion rates for blood flow, measure the physical sizes of 
anatomical structures and assign a value to the process of gastric reflux. 

An example of such a protocol which provides quantitative results is given in 
^Automatic quantitative analysis of cardiac MR perfusion images'. Marcel Breeuwer et al., 
10 Proceeding SPIB Medical Imaging, vol. 4327, February 2001, San Diego, USA. This 

describes an automatic quantitative analysis method for evaluating blood perfusion in the 
heart muscle, or myocardium. It is known that the method sometimes produces occult 
inaccurate quantitative results. In other words, the image analysis process can produce 
quantitative results which may be clinically useful or clinically misleading but without any 
15 indication of which of these two groups any given quantitative result lies in. 

It is an object of the invention to provide the user of quantitative image results 
with more reliable image data. 

Tliis is achieved according to the method of the invention whereby tiie result 
of an error analysis, performed ui order to provide information relating to the accuracy of the 
20 quantitative evaluation, is also delivered as an ou4>ut 

The image data used by the protocol can be degraded by a variety of processes 
which are implicit within the data as a result of the limitations of image acquisition or 
processmg. Whm tiiese have a visible effect on the image they are known as artefacts. One 
example of an artefiict is noise, the statistical variation in voxel intensity value, which adds 
25 an intrinsically unquantifiable value to the real mtensity value which is allocated to any 

particular voxel. Ilie process of image reconstruction assumes that it is possible to assign an 
exact value to this voxel intensity, whereas in reality the value assigned is always a 
composite of the real value which describes the tissue being represented by the voxel and an 
extra value ascribed to noise. When a protocol aimed at deriving quantitative results is 



wo 2004/070659 



PCT/IB2004/050033 



applied to the image, is utilizes the intensity values designated to each voxel as basic input 
values. The noise element of the intensity value is fed into the evaluation process along with 
the part of the intensity value which represents the real tissue and ttie inclusion of the noise 
value feeds an error into the eventual quantitative result. 

5 Other processes which degrade the image have a similar effect, albeit for 

different reasons, on any eventual mathematical result. For example, the partial volume 
effect, by which voxels representing tissue matter at, or near, the boundaries of tissue 
divisions characterized by different intensity values, are rendered with intensity values which 
are merely averages of the surrounding intensities. This introduces entirely spurious intensity 

10 values which, when fed into a quantitative evaluation process, again introduce an inaccuracy 
which is difBcult to perceive. 

The processes which have an effect on the eventual image also include the 
inherent limitations of the imaging process and the imaging steps taken to translate that 
process into a visual end result For sample, the resolution of the digital image, which can 

15 be thought of as the smallest object in the image whidi can be detected, influences any final 
quantitative result derived from the image. A higher resolution is achieved in a digital image 
by displaying the image using a greater number of pixels. This spreads the overall 
information content in the image over a larger nimiber of pixels and in the case of an image 
derived from radiation will increase the statistical fluctuation of the intensity value in each 

20 pixel. However, a greater resolution, and therefore a larger number of pixels, will result in 
more pixels being included in any regional contour imposed on the image for the purposes of 
quantitative analysis. This will have the result of unproving the statistical fluctuation of the 
eventual quantitative result 

These, and other artefacts and contributory processes having an effect on the 

25 quantitative analysis, can be modeled. As a first step, the quantitative information, or data, 
which is presented as an output of the normal quantitative analysis can be modeled, either 
mathematically by using equations or by synthetically constructing data. Both of these 
procedures would be well known to those skilled in the art of medical image analysis 
processes and result in the quantification of an ideal process, as it would be if unaffected by 

30 atte&cts or any error introduced into the quantitative process. This ideally quantified process 
also therefore reveals a fmal, ideal, quantitative result representing a quantitative result as 
would be achieved if there were no artefacts in the image nor any other introduced error. 

Once this ideal quantitative analysis has been modeled and an ideal 
quantitative result produced, the next step is identify possible image arte&cts and unage 
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processing steps and to evaluate the influence of these on the quantitative analysis or 
quantitative evaluation. Such artefacts and image processing steps may include, as is known 
to those skilled in the art of medical image analysis, image resolution, noise, partial volume 
effect, sampling rate, time intensity behavior, subject motion, the production of outlier image, 
5 the effects of residual contrast e^ent, registration inaccuracies, segmentation inaccuracies and 
errors in placing contours. As will be appreciated by those skilled in the art, there may be 
other processes which affect the image data in such a way as to introduce an error into the 
quantitative process, and the invention may therefore be worked so as to incorporate those 
processes. 

1 0 The identified image processing steps and arte&cts are evaluated for their 

effect on the ideal quantitative result This can be by a process of mathematical modeling or 
by the use of a phantom, or by both. For example, statistical image noise, as is known to 
those skilled in the art, can easily be modeled as a standard deviation. This statistical 
variation can be added to the ideal model of the quantitative process with tiie result tiiat the 

1 S final quantitative result varies firom the idea. Hie error introduced into the quantitative result 
has therefore been modeled. 

All the artefacts or image processing steps considered to be potentially 
influential on the final quantitative result can be likewise modeled in ways which are known 
to those skilled in the art. In each c£ise, the effect produced by the modeled process on the 

20 final quantitative result can be calculated and therefore assessed for its quantitative 
importance. 

Once this step has been completed, according to the method of the invention, 
the most unportant unage processing steps and image arte&cts which contribute to tiie 
overall degradation of the image are identified There are no hard and &st rules as to which, 

25 out of all the image processing steps and all of the possible image arte&cts, should be chosen. 
The number of individual influencing items considered to be ultimately important will 
depend on how reliable the user of the eventual quantitative data would like that data to be. 
This may also depend on the specific fectors present in the particular quantitative process 
under evaluation. For eTcample, noise is a feirly constant artefact in all images but motion 

30 arte&cts are more likely to occiu- in image sequences which represent internal anatomical 
motion, such as the motion of the diaphragm, say, during breathing. If the method were 
applied to the evaluation of the accuracy of simple quantitative measurement of a static 
anatomical structure, there would be littie reason to include a motion artefact 
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Yet another example of an influencing characteristic is mtensity 
inhomogeneity, which can cause image artefiicts in magnetic resonance images. Intensity 
inhomogeneities originate &om the inhomogeneous sensitivity profile of receiver coils, and 
especially surface coils. These inhomogeneities can be observed as a variation in intensity 

5 across the im^e and causes pixels representing the same tissue type to be rendered with 
unequal intensities. The effect of intensity inhomogeneities on an analysis outcome can be 
very severe because the range of intensities used for the same particular tissue type can 
influence the correct recognition of that tissue type and therefore the tissue type boundaries in 
a contouring or segmenting procedure. 

10 Following an identification of the important processes affecting the accuracy 

of the quantitative process, the method of the uivention proceeds with a more detailed 
modeling of tiie effects of the combination of the influencing processes. The important 
processes are now ascribed values, as is known to tiiose skilled in the art, and fiirther 
evaluated using all combinations of values of each of the processes. 

1 5 This modeling of the jomt effect of tiie important artefacts and image 

processing steps on the model of the quantitative analysis allows a further numerical 
evaluation of tiiese for their effect on accxiracy. It may be, for example, that the form of the 
quantitative analysis under consideration renders three or four particular processes amongst 
the artefacts and image processing steps as highly influencing. In such a case, the invention 

20 proceeds with a more detailed investigation of just these three or four processes. As is known 
to those skilled in the art, all of these processes can be ascribed a range of values, but if they 
are ascribed a discrete range of values, then discrete numerical combinations of them can be 
added to the ideal quantitative model to produce another quantitative result representing, 
now, the effect of that particular combination of values of those processes on the quantitative 

25 analysis. 

The results of this analysis of inaccunu^ can be stored in a look up table or 
indeed in any multi-dimensional table, as is known in the art, or may be stored withui a 
formula. In other words, the values are stored in such a way that knowledge of the 
combination of values of the influencmg processes leads to the value of tiie OTor mtroduced 
30 by that combination of values. The results, once accessed, can be presented to the viewer 
along with the mathematical quantitative result of the imaging analysis process. 

Knowledge of the combination of values of the influencmg processes within a 
medical image analysis process can be easily determined by those skilled in the art. Noise, 
for example, can be easily quantified by taking a sample of a medical image where that 
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sample contains only noise and measuring the intensity values rendered in each pixel to 
calculate the value of the standard deviation of the variation of those intensity values. Values 
can, by other analytical processes, be attributed to other influencing artefacts and imaging 
processes by those skilled in the art 

5 Storage within a formula, in this case, is useful when the combinations of 

values of the influencing processes, and their resulting effect on the error within the 
quantitative analysis, can be easily modeled. When this is the case it has the advantage that it 
saves on the computing power which would otherwise be needed when the results are stored 
in a muM-dim^isional table of high dimensional order. 

10 It is important to note that in the case of a particularly simple quantitative 

analysis^ it may be possible to perform the error analysis and calculation during the 
quantitative analysis itself. This may be possible, for example, v^en there is only one 
influencing process, say noise, and this can be analyzed and evaluated during the original 
unaging process itself. In such a case, storage may not be necessary. It is also possible that 

IS only a smgle error result could be handled and delivered by the method of the invention as an 
output 

An important point to be aware of is that all these diverse effects on the 
quantitative content of a medical image can be appreciated qualitatively by any user with a 
good understanding of the physical processes behind medical imaging, but cannot be 

20 accurately perceived on an individual case by case basis. In other words, we can say with 

some degree of certainty that the noise in an image has contributed to the inaccuracy of some 
mathematical quantity extracted from the image, but we cannot assess the exact quantitative 
efTect just by looking at the image. Smularly, we can understand that partial volume effect 
may have introdxiced an inaccuracy into a consequential quantitative result but are completely 

25 unable to tell by lookmg if indeed it has or what the quantitative effect might be. 

The invention provides the user with more reliable image data because it 
solves the problem of how to assess the accuracy of quantitative results which are dependent 
on the medical images. Quantitative results which are derived from medical images are based 
on the contents of tiie medical image data and such data content is visually complex and 

30 difficult for the eye to assess. Early medical images were developed directiy onto hard copy 
and viewed by the user, so any analysis of the image was restricted to a qualitative 
assessment only. The advent of digitization and the application of modem digital data 
handling to medical imaging has placed the viewer in an unparalleled position in the history 
of medical evaluatioiL The user is now in a position to analyze the information content of the 
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medical images with which he is presented and extract quantitative values. But medical 
images, as aggregates of pixel intensity values, contain fer too much parallel information for 
a single viewer or user to mentally assess the quantification within the image. The viewer of 
digital medical image information who wishes to use the mathematical results of a 
5 quantitative analysis has no way of visually assessing how reliable, repeatable or siccurate 
tiiose results are by himself. Therefore evaluating and presenting a value for error in a 
quantified extracted result allows the user to assess the reliability of the results in a way 
* which was not previously available to him. For this reason, the invention as described adds 
an important contribution to the use of medical image analysis processes for the extraction of 
1 0 quantitative data. 



The invention is fiirtiier explained for those skilled in the art with the help of 
the following figures. 

15 Fig. 1 shows the normal process of imaging analysis which can be improved 

using the method of the invention. 

Fig. 2 shows the processes by which error influences the calculation of 
quantitative data, and how this process is then modeled according to the method of the 
invention. 

20 Fig. 3 shows the filling of a table of data, according to the method of the 

invention. 

Fig. 4 shows the extraction of data in the course of a real imaging analysis 
process to which the invention has been applied. 

25 

Fig. 1 gives a graphical representation of the effect which arte&cts, imaging 
processes affect a quantitative image. Any such influencing process or parameter, pi, for 
example, is incorporated in an image analysis lA, 101, with the result that the ou^ut of that 
image analysis, i, becomes a function of the influencing parameter. So, for example, 
30 numerous arte&cts such as noise, partied volume effect, and unaging processes such as 

registration may affect the image analysis as pi, p2 and pa. The resulting image is dependent 
on the values of these parameters and can be expressed as i(pi, p2, pa). In the most general 
case, as shown in Fig. 1, the image is affected by an unquantified number of parameters, pw, 
and the resulting image can be expressed as i(pi, P2» . . . , Pn), or i(B). 
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Fig. 2 gives a graphical representation of the modeling process utilized within 
the invention. An ideal image, completely imaffected by artefacts and containing no error 
mtroduced by the imaging process, can be expressed as i(0,0,. . .,0), or If this is fed into 
the image modelmg process DM, 201, it will result in a baseline value for the quantitative 
5 result, QA(2d). The important, or most influential, artefects and imaging processes deemed to 
have an effect on the overall process of quantification act together to produce an image i(pi, 
P2, ...,Pn), which, if subject to the same image modeling process IM, 201, results in further 
quantitative result. QA(e). This quantitative result, QA(e), is inaccurate in tiiat it deviates 
fix>m the ideal result, QA(eo), and this difference A(p), can be measured as the difference 

1 0 between the two quantitative residts, QACed) and QA(e). 

Fig. 3 shows a metiiod for constructing a table, according to the invention, by 
which the error which is introduced into the quantitative process by tiie parameters with the 
most influence can then be utilized to provide the user of the quantitative process with 
information accordmg to the mvention. Fig. 3 shows this usmg a simplified model utilizing 

1 5 only two parameters. 

Parameters, pi and p2, which influence the quantitative process can take 
different values. Normally the values would vary over a continuum, but for the purposes of 
modeling are restricted to discrete values pi(l), pi(2), pi(M) for pi and p2(l), p2(2), p2(M) for 
P2. Images containuig all combinations of these values are then remodeled using the 

20 modeling processes developed so that quantitative results QA(pi, p2) are produced for all 

combinations of values for pi and p2. These values all vary fi-om the ideal quantitative result 
QA(eo), where pi and p2 are both zero, by some difference, A(p), and these differences are 
then fed into a table 301 for future use. The form of the value representing this difference 
may be stored as the basic value of variation, or may be stored as a percentage difference or 

25 indeed m any other formulation which allows it to be used as a quantification of error. 

The case desoibed above concerns only two parameters, pi and p2, and 
therefore shows a two dimensional table. A greater number of parametra would be stored in 
a table witii the equivalent number of dimensions, as would be obvious to one skilled in the 
art 

30 Fig, 4 shows the method of the mvention as perceived by the end user. The 

various values of and A(e) have been inserted mto the table 401 fi-om which the error, A(e), 
can be read out. These results can now be applied to a real imaging session, 402, m which 
images for the purpose of quantitative analysis are produced. These images must be further 
analyzed to estimate, or evaluate, the values of the influencing parameters, g, which are 
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incorporated into the image results of the real imaging session. This is easily done by those 
skilled m the art using known techniques, and results in a series of values, pi(M) and P2(m), 
for example, which can be used to address the relevant value of error, A(jq). In the case where 
the values attributed to £ do not coincide completely with the values stored in the table, any 
5 interpolation or approximation method can be used, as would be apparent to those skilled in 
the art Hie value, A(e), can be presented to the user in any known way, to allow the user to 
assess the accuraxry and reliability of the quantitative result of the medical image analysis 
process. 



